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Free-space communication allows one to use spatial mode encoding, which is susceptible to the effects of 
diffraction and turbulence. Here, we discuss the optimum communication modes of a system while taking such 
effects into account. We construct a free-space communication system that encodes information onto the plane- 
wave (PW) modes of light. We study the performance of this system in the presence of atmospheric turbulence, 
and compare it with previous results for a system employing orbital-angular-momentum (OAM) encoding. We 
are able to show that the PW basis is the preferred basis set for communication through atmospheric turbulence 
for a large Fresnel number system. This study has important implications for high-dimensional quantum key 
distribution systems. 

Keywords: Free-space optical communication; Optical vortices; Quantum communications; Quantum key 
distribution. 



1. Introduction 

Free-space optical links provide an easy means of high-bit-rate communications for line-of-sight 
systems. Furthermore, these links require a much simpler infrastructure as compared to fiber- 
based systems. The majority of the proposed applications of free-space optical communications 
use polarization, wavelength, or the time degree of freedom of the optical fields for encoding 
information |l|, |2( . Recently, there have been a number of studies suggesting the use of spatial 
profile of optical fields as an extra degree of freedom for encoding information [3|— lS|] . It has been 
demonstrated that the use of spatial modes as an extra layer of multiplexing can substantially 
increase the bit rate of a classical communication link [y|. In addition, the large Hilbert space of 
spatial modes makes quantum key distribution (QKD) systems more tolerant to eavesdropping 
errors [21]. 

Orbital angular momentum (OAM) is often suggested as a preferable set of spatial modes for 
free-space communication. It has been argued that, in principle, there is no limit on the number 
of bits of information that can be carried by a single photon using this encoding scheme [3, 6]. 
In practice, however, the number of spatial modes that can be communicated in any free-space 
system is always limited by the undesired effects of diffraction and atmospheric turbulence. In 
the presence of these adverse effects, the choice of optimal encoding basis is not obvious. In 
this paper, we briefly review the effects of diffraction on the propagation of scalar fields. This 
analysis suggests that the OAM modes form an optimal basis for optical systems with rotational 
symmetry. However, in practical systems with large apertures, diffraction does not play a major 
role, and the channel capacity is mostly limited by turbulence. Motivated by this argument, 
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we experimentally investigate the propagation of an alternative group of spatial modes in the 
presence of atmospheric turbulence. This basis comprises an orthonormal set of uniform beams 
with tilted wavefronts, also known as plane wave (PW) modes. The set of PW modes forms a large 
orthonormal basis set that can be used for encoding information. Furthermore, the PW modes 
can easily be separated by using a single lens at the receiving aperture. Mode decomposition 
analysis is used to perform a quantitative comparison of the performance of PW and OAM 
modes under the adverse effects of turbulence. The results suggest that the PW basis is more 
robust against atmospheric turbulence, closely confirming the theoretical predictions of Boyd et 
al. (|. 



Diffraction and communication modes 



Consider a prototypical free-space communication link as depicted in Fig. [TJ Due to diffraction, 
a spatially confined beam generated in the transmitting aperture spreads upon propagation. 
The area of the beam over which most of its energy is confined can be calculated at any plane 
using diffraction theory. However, after propagating beyond the near field, the beam has long 
tails which continue toward infinity in the transverse plane[9|. Since the receiving aperture has 
a finite size, a portion of energy of the beam will be lost in the detection process. Additionally, 
the strength of this induced loss is dependent on the form of the transmitted field. As a result, 
a set of initially orthogonal fields in the transmitting aperture will no more form an orthogonal 
set at the receiving aperture, and it is not passible to perfectly discriminate between them. The 
problem of finding the optimum set of modes for transmitting energy and information from one 
finite aperture to another has long been investigated in the context of apodization theory [10| 
and the theory of communication modes [J] . 

The input-output characteristics of a communication link can be described using the Rayleigh- 
Sommerfeld diffraction formula, which describes the free-space propagation of an arbitrary scalar 
field 



^out(r R ) = / ^ in (r T )K{r T ,r R )d 2 r T , 



(1) 



in which VPi n ( r T) an d ^out( r R.) are the electric fields in the transmitting and the receiving 
apertures. The propagation kernel K{yt-,y r ) can be written as [9( 



K(r T ,r R ) 



1 d exp(ik | yt — yr 
2ir dz | yt — tr \ 



(2) 



Eq. ([I]) indicates that the fields in the two apertures are related via a linear transformation. 
Using Dirac notation, this transformation can be written simply as | ^>out) = P \ ^in), where 
P is the propagation operator. Note that the propagation kernel as defined above represents a 
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Figure 1 . Schematic diagram of a free-space communication link. 
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unitary transformation. In order to calculate the detected field, we must take into account the 
finite size of the apertures. This imposes the condition K(vt, tr) = for m > R\ and tt > Ro- 
As a result of adding this constraint, the propagator is no longer a unitary operator. A non- 
unitary transformation does not preserve inner products. Hence a set of orthogonal modes in the 
transmitting aperture are not necessarily orthogonal in the receiving aperture upon propagation 

{^m-out | ®n-out) = {P^m-in \ P^n-in) = {^m-in I P ] P I * ' n-in) + 0. (3) 

Note that since P is not unitary, P'P need not constitute the identity matrix. However, it 
is still possible to find a specific set of orthogonal modes in the transmitting aperture which 
remain orthogonal upon propagation. These modes can be found by performing a singular value 
decomposition (SVD) of the propagator operator. This can be formally expressed as 

Ptp | $ n > =| A n | 2 | $ n ). (4) 

The functions |$ n ) are sometimes called the communication modes of the system [J, [ll|]. The 
coefficient | A 2 | is a coupling coefficient and is equal to theportion of the energy of the corre- 
sponding mode which falls within the receiving aperture [4l. Il2||. 

The SVD procedure guarantees that the communication modes form a complete orthonormal 
set in the receiving aperture. 

Y&m-out | ^n-out) = (^m-in \ P P \ ^ n-in) =| A n | (^ m _i n \ fy n _i n ) =\ \ n \ mn . (5) 

Therefore, these modes form a preferred set for free-space communication. In order to find 
the exact form of the communication modes, the SVD procedure has to be performed on the 
propagator using the exact shapes and sizes of the apertures, as well as the distance between 
them. Considering the fact that the transformation kernel includes a rapidly oscillating term, 
the SVD procedure is a numerically demanding task for any system with a dimension larger 
than a few optical wavelengths. In the rest of this section, we utilize a combination of symmetry 
considerations and approximations to find an approximate solution for the communication modes 
of a realistic system. 

A real-world communication link usually consist of circular components such as lenses, aper- 
tures, and mirrors. In this situation, the rotational symmetry of the system can be exploited to 
find analytical solutions for Eq. ([4]). Assuming paraxial Fresnel diffraction, it can be shown that 
the solutions have the form 

* n4M ) = *»Me u *, (6) 



where the radial parts R nt i (p) are known as the generalized prolate-spheroidal functions K], LL3J] . 
The azimuthal dependence e ^ suggests that these solutions are eigenfunctions of the orbital an- 
gular momentum operator [14|. The eigenfuntions of Eq. ([6]) provide a complete two dimensional 
basis set for free-space communication between two circular apertures. In practice, however, it 
is easier and more common to create optical fields which still retain the vortex feature of e ^ , 
while using the radial profile of a Laguerre-Gaussian or a top-hat beam. This is because the func- 
tional dependence of the solutions on the radial and the azimuthal coordinates is separable, and 
any two functions with different OAM indices maintain their orthogonality upon propagation, 
regardless of their radial form. 

The logic presented above suggests that OAM modes are the natural choice for encoding 
information in a free-space optical link. However, it can be shown that for an optical system 
with sufficiently large apertures, finding communication modes and their coupling coefficients is 
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a nearly degenerate problem [151 ]. This means that for a given coupling coefficient A n , there exist 
multiple functions \]/ n satisfying Eq. ()4|). The number of these modes is approximately equal 
to the Fresnel number product of the system Np = jfr§ , an d their coupling coefficients are 
almost equal to unity [l2|, Ilia] • This specific subset of the eigenfunctions is sometimes known as 
the degenerate communication modes. It is easy to see that, as a consequence of degeneracy, any 
linear superposition of the degenerate communication modes is itself an eigenfunction of Eq. @. 
This allows us to use a linear transformation to map the degenerate communication modes to a 
new set of orthonormal modes. One such basis that can be formed using a superposition of the 
communication modes of Eq. (|6|) is the basis of PW modes. 

In the present article, we explore the possibility of employing an encoding scheme based on 
the use of the PW modes of light. This study is partly motivated by the fact that the generation 
and separation of PW modes are simple as compared to those of OAM modes. OAM modes are 
conventionally generated using high-resolution spatial light modulators [l6( or a series of forked 
holograms jfij, whereas to generate a PW mode, one has to simply add a wavefront tilt to a 
top-hat beam. Similarly, sorting OAM modes needs carefully crafted custom optical elements 
[HI, ll3], which are very sensitive to misalignment [l9(. The process of separating PW modes, on 
the other hand, can be achieved with a single lens. This lens transforms different PW modes to 
spatially separated spots in its focal plane. 



3. Effects of turbulence on PW and OAM modes 

In a classical communication system, aberrations induced by turbulence on the transmitted 
modes result in a spread of the detected modes in the receiver, increasing the cross-talk and thus 



reducing the channel capacity of the system la, |20(]. In a QKD system, the turbulence induced 



loss of quantum coherence results in an increase of the error rate which can compromise the 
integrity of the protocol [a] . Here we consider the role of atmospheric turbulence on a free-space 
communication system that employs PW encoding at high light levels. The connection between 
quantum and classical properties can be understood by considering the fact that photons are 
units of excitation of the modes of light. Therefore the mode mixing introduced by the turbulence 
affects both classical and QKD systems in identical ways. 

In our system, the transmitting aperture is imaged onto the receiving aperture. This situation 
represents the Np —> oo limit in which the effects of diffraction can be safely ignored. For 
such a system, turbulence can be modeled as a thin phase-screen in the transmitting aperture 



211 ] . This single phase-screen approximation is valid as far as the aberrations introduced by 
the turbulence are not too large. The phase aberrations can be described by normal random 
variables characterized by the quantity ([4>(fi) — 0(r2)] 2 ). This quantity is known as the phase 
structure function and can be evaluated using Kolmogorov turbulence theory to give the result 

5/3 



Mn) - <P(r 2 )] 2 ) = 6. 



Xi - X 2 



To 



(7) 



The parameter r$ is known as Fried's coherence parameter and is a measure of the length of 
correlation of the phase aberrations [221 ] . 

Using the model of phase aberrations introduced above, Boyd et al. have analyzed the effects 
of turbulence on the propagation of PW modes [8|. The PW modes considered here are confined 
to a finite square aperture and have tilts only in one dimension. These modes as launched by 
the transmitter can be represented as 

A(x, y) = A W{x/L)W{y/L)e m ^ (8) 



April 3, 2013 1:26 Journal of Modern Optics PWExperiment 



Journal of Modern Optics 



(a) 



HeNe 



spatial filter 



SLM 




(b) 



(c) 




f = 750mm 



Figure 2. (a) A PW mode is prepared by using a phase grating, of the sort shown in (b). This procedure is realized through 
use of an SLM illuminated by an expanded He-Ne laser beam. The first order diffracted beam is imaged by a 4-f system 
onto the receiving aperture, where a 750 mm lens separates the modes, (c) Thin-phase turbulence is added to the phase 
grating. The first-order diffracted beam in this case represents a PW mode after propagation through turbulent atmosphere 



where ^o is the field amplitude, W(£) is the aperture function defined so that W(£) = 1 for 
| £ |< 1/2 and zero otherwise, and m is the mode index of the launched field. The theoretical 
analysis in Ref. |8| suggests that the turbulence-induced cross-talk in the detection of these 
modes can be calculated by evaluating the integral 



<SA> 



1/2 



di] 



■q e 



-3A4(nL/r ) 5 ' 3 



cos(47rAry) 



(9) 



where L is the width of the rectangular transmission aperture, and (sa) is the conditional 
probability of detecting a photon in the PW mode m + A, given that the photon was sent in 
the PW mode m. The integration is performed over the normalized transverse coordinate r] . 
Since the integral in Eq. Q is only an explicit function of L/r$, the cross-talk probability can 
be quantified using this single parameter. 

A similar approach has previously been used to analyze the effects of turbulence on propagation 
of OAM states 2314251]. A numerical comparison of the performance of PW modes versus OAM 
modes has been done in Ref. [8J]. The authors have concluded that the PW encoding is less 
quickly degraded by a factor of about three. In this paper, we experimentally verify this result. 

Fig. ([2]) shows the schematic diagram of our experiment. Spatially collimated light from a He- 
Ne laser illuminates a spatial light modulator (SLM), which is utilized along with a 4f system 
and an aperture to generate different PW modes. Since the turbulence is modeled by a single 
phase-screen in the transmitting aperture, the same SLM is used to impress Kolmogorov phase 
aberrations onto the beam . A 750 mm lens is employed at the receiving aperture to sort the 
different PW modes into spatially separated spots in its focal plane. A CCD is used for recording 
the intensity profile of the sorted modes in this plane. 

When the turbulence phase-screen is not present, each mode will map to a diffraction-limited 
spot on the CCD's screen. We divide the area on the CCD into non-overlapping adjacent spatial 
bins which correspond to the central positions of these spots. In the presence of turbulence, 
each mode will form a random shape on the screen. The amount of beam power falling within 
a spatial bins is proportional to the value of (sa) for a given input mode. We have measured 
these values in 51 different regions corresponding to | A |< 25. A range of turbulence levels 
characterized by L/r$ £ [10 -2 : 10 2 ] was tested. For each value of L/tq, the results are averaged 
over 100 phase-screens. To stay within the spatial bandwidth of the SLM, the minimum value 
of r$ was chosen to be sufficiently large . 

The theory presented in Ref. [8] dictates that the average cross-talk values (sa) are independent 
of the transmitted mode index m. We have verified this property by repeating the experiment 
for all possible input modes in the chosen range. Barring experimental errors, the results are 
identical for different values of m. The measured values of (sa) for the m = case are presented 
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Figure 3. (a) Average cross-talk values (sa) for PW modes are plotted as a function of turbulence level L/ro for the m = 
input. The experimental data is presented by crosses whereas the theoretical predictions are shown by the solid lines. The 
plots level off to constant values at the limit of very little turbulence due to the residual cross-talk arising from our sorting 
technique, (b) The theoretical and experimental values of (s^) for an £ = OAM mode as reported in Ref. [1611 . 

in Fig. [3|a) for the range of < A < 4. The A = line represents the fraction of the power that 
remains in the launched mode after propagation through atmospheric turbulence. The other 
curves indicate the portion of the power that has been transferred to the neighboring modes. As 
it can be seen, the A = line begins at a value close to unity and drops steadily as the turbulence 
strength increases. The curves for all other values of A initially increase as L/ro increases and 
eventually decrease with a further increase of L/ro. The decrease at high turbulence levels occurs 
because the power in the input mode spreads among more and more PW modes. It can be seen 
that for a sufficiently large value of L/ro the optical power spreads equally among all the modes. 

We previously measured the performance of OAM modes for the same range of turbulence 
values [la]. For comparison, the OAM results from this previous experiment are shown in Fig. 
EJb). It should be emphasized that the turbulence strength in this case is characterized by D/r , 
where D is the diameter of the circular transmitting aperture. It is seen that the OAM cross-talk 
values behave in a qualitatively similar fashion to those of the PW modes. To make a quantitative 
comparison possible, the A = values for OAM and PW modes are presented on the same plot 
in Fig. IHa). It can be seen that the power remains in the transmitted PW mode for larger levels 
of turbulence as compared to the OAM mode. More specifically, the PW curve reaches the same 
value as that of OAM at a turbulence level that is almost three times larger. 

The consequences of these results for a communication link can be better understood using 
the concept of channel capacity. From the information theory, the channel capacity of a commu- 
nication channel is defined as 



C = max[ff(x) - H{x \ y)) 



max 
{Pi} 



(10) 



Here, N is the total number of modes in our system, P, is the probability of transmission of mode 
i, and P{j is the conditional probability of transmission of mode i followed by detection of mode 
j. We can calculate the channel capacity of our PW channel using the values of Pd s = {s^-s))- 
Experimental data for the channel capacity of the PW communication channel with N = 7, 9 
and 11 are shown in Fig.HKb). The channel capacity, C, is plotted as a function of the turbulence 
strength L/ro- F° r comparison, we have plotted the data for an OAM channel from Ref. [a] on 
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Figure 4. (a) The fraction of energy so staying in an m = PW mode as it propagates through atmospheric turbulence is 
plotted along with the so values for an (. = OAM mode, (b) Influence of Kolmogorov turbulence on the channel capacity of 
a PW communication channel as compared to that of an OAM channel. The channel capacities are calculated for a system 
dimensionality of N = 7, 9 and 11. The solid lines present the theoretical predictions as fitted to the measured channel 
capacities at zero turbulence level. 

the same figure. In both cases, the measured channel capacities are substantially lower than the 
theoretical limit of log 2 N due to the limitations of the sorting techniques. It can be seen that 
the channel capacities for the PW modes tend to decrease much slower than those of the OAM 
modes as the turbulence level increases. More significantly, there exists a range of turbulence 
values for which the PW channel has non-zero capacities while the channel capacity of the OAM 
channel is almost equal to zero. 



4. Conclusions 

In summary, we have analyzed the performance of PW and OAM encodings in free-space com- 
munication systems employing spatial modes. Reviewing the theory of communication modes, 
we conclude that that the OAM basis set is the preferred encoding scheme when the effects of 
diffraction are dominant. In practical systems with large apertures where the effects of diffrac- 
tion are negligible, the choice of encoding basis needs to be made considering the performance of 
the basis set under the effects of atmospheric turbulence. We have considered the PW basis as 
a candidate for such systems considering the simplicity of their generation and separation. The 
effects of Kolmogorov thin-phase turbulence on propagation of PW modes were studied experi- 
mentally. We have quantitatively compared the channel capacity of a PW-based communication 
system with the previous results from OAM-based systems. Our results suggests the PW basis 
as the preferred encoding scheme for high Fresnel number communication systems. We would 
like to thank Stephen Barnett, David Miller, and Daniel Gauthier for helpful discussions. This 
work was supported by the DARPA/DSO InPho program and the Canadian Excellence Research 
Chair (CERC) program. 
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